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1. INTRODUCTION 
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ABSTRACT 
There is a current research interest into high-leverage teaching 
practices which are geared towards making concepts explicit to learners. 
Explanations are a common practice in science education for sharing and 
constructing meaning with students. However, current studies insufficiently 
articulate a framework for understanding pre-service teachers explanations; 
neither do they assess the practical criteria for development. ‘This article 
documents various criteria for pre-service science teachers’ explanations 
as related to the cognitive science literature and their assessment in the 
context of an instrument designed for teacher education. A rubric was 
constructed which organized structural and supportive elements into three 
levels. A validation process is described, and its application in teacher 
education programs to detect possible patterns and changes in pre-service 
science teachers explanations. The results show the explanation strengths of 
pre-service teachers working with examples, graphs and images. However, 
difficulties were found in using and improving analogies, metaphors, and 
models, and also approaching mis-conceptions as a learning opportunity. 
Theoretical and practical issues are discussed from a cognitive perspective. 
We conclude that the signaling implications of using rubrics sensitive to 
progress-monitoring during teacher education for high-leverage teaching 
practices give opportunities to simulate and rehearse practices that are highly 
conducive to learning. 
© 2018 IJCRSEE. All rights reserved. 


education (Koteva-Mojsovska and Nikodi- 
novska, 2015; O’Flaherty and Beal, 2018). 


Researchers and teacher educators seek 
to evaluate what educational practices are 
highly conducive to learning. Within which, 
high-leverage practices have been specifically 
identified (Ball and Forzani, 2011) as teaching 
practices with an impact on student learning, 
which are learned and implemented by be- 
ginner teachers (O’Flaherty and Beal, 2018). 
There is also increased interest in assuring 
teacher capacity development during teacher 


Corresponding Author 

Dr. Valeria M. Cabello, Pontificia Universidad Catolica 
de Chile, Chile 

E-mail: vmcabello@uc.cl 


OS® 





ee Le | 8 
This work is licensed under a Creative Commons Attri- 
bution - NonCommercial - NoDerivs 4.0. The article is 
published with Open Access at www.ijcrsee.com 


Nonetheless, current studies insufficiently ar- 
ticulate a cognitive framework for understand- 
ing teachers’ explanations as a means of mak- 
ing scientific concepts explicit. Considering 
that explaining 1s crucial for children’s discov- 
ery and connecting daily life phenomena with 
underlying principles (Legare, Gelman and 
Wellman, 2010), this is problematic. Teacher 
explanations also form a high-leverage teach- 
ing practice (Windschitl, Thompson, Braaten 
and Stroupe, 2012). 

Explanations are communicative actions 
intended to make sense of a phenomenon, di- 
vulge its meaning and make it understandable 
or apprehensible for learners (Thagard, 1992; 
Norris, Guilbert, Smith, Hakimelahi, and Phil- 
lips, 2005). It can also be understood as the 
act of answering a ‘why?’ question about phe- 
nomena (Norris et al., 2005). Explanations in 
teaching intend to share knowledge and un- 
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derstanding with other people who have the 
intention of learning (Treagust and Harrison, 
1999). 

A common point for the development 
of high-leverage practices such as explana- 
tions is the relevance of practical experience 
for enacting teaching (Koteva-Mojsovska and 
Nikodinovska, 2015). However, simulations 
of teaching provide a systematic approach to 
teaching actions without the cognitive and 
emotional load of real classroom settings. 
Thus, simulations of explanations for a future 
classroom can be beneficial in teacher educa- 
tion. This particular field is being explored 
with respect to defining what characterizes ex- 
planation for the classroom and showing it 1s 
a learnable capacity (Charalambous, Hill and 
Ball, 2011). However, no studies have been 
conducted which formatively evaluate expla- 
nations from a cognitive perspective within 
science teacher education. 

Consequently, there is little knowledge 
available for student science teachers to build 
explanatory capacity before they start real 
teaching work. Sevian and Gonsalves (2008) 
constructed a rubric to assess how science 
students communicated their research find- 
ings to diverse audiences. Although this was 
an advance, they did not address constructing 
explanations for teaching and learning, which 
differs in context from and purpose from ex- 
planation / communication of science between 
professionals or scientists. 


1.1. Explanations for teaching 
Science and scientific explanation 


The act of explaining has captured the 
attention of educators, scientists and philos- 
ophers, especially regarding what defines a 
scientific explanation (Geelan, 2013). Diverse 
meanings have been given to the term expla- 
nation (Rodrigues and Pereira, 2018). Thus, it 
is relevant to differentiate scientific explana- 
tions from teacher explanations. 

On the one hand, scientific explanations 
are the main product of scientific activity (Ro- 
drigues and Pereira, 2018), usually in the form 
of an evidence-driven explaining statement. 
The purpose of such a statement is to com- 
prehend a phenomenon and share this under- 
standing to the scientific communities. Hence, 
correct scientific vocabulary is relevant (Tre- 
agust and Harrison, 1999). 

On the other hand, teacher explana- 
tions for teaching science combine axioms, 
concepts with metaphors and analogies con- 


necting them to compose a coherent entity 
(Geelan, 2013). The purpose is to enhance 
understanding and lead students to construct 
meaning. Teacher explanations are not oppo- 
site to inquiry-based learning and other con- 
structivist approaches, because they may not 
be closed and they are not limited to lecturing 
on a topic (Geelan, 2012). 

Certainly, explanations for the class- 
room can be collaboratively shaped; created 
from parts of students’ ideas and teachers’ 
counterparts through iteration (Dawes, 2004). 
Consequently, explanations for teaching sci- 
ence differ from scientific explanations in 
their rigor, details and purposes (Treagust 
and Harrison, 1999). Furthermore, the trans- 
formation of the scientific explanation into a 
thoughtfully produced teaching form intended 
to promote learning is the main feature of a 
teacher explanation (Ogborn, Kress and Mar- 
tins, 1996). 

The synergy of learners’ and teachers’ 
ideas in generating explanations in the class- 
room can be achieved by teachers connecting 
and contrasting learners’ prior ideas with the 
explanation. Moreover, by students question- 
ing teachers’ explanations and critically ana- 
lyzing the sources of explanations, they nego- 
tiate the meaning of a shared explanation and 
thereby enrich them. 


1.2. Styles in science teachers 
explanations 


Explanations in teaching science have 
been considered as a way of explicating 
knowledge to a non-expert audience (Treagust 
and Harrison, 1999), but in teaching this is not 
the only function. Explanations for the class- 
room transform the expert knowledge into a 
different but connected type of knowledge, in- 
telligible and more accessible for school learn- 
ers (Ogborn et al., 1996). This is Pedagogical 
Content Knowledge (PCK); the amalgam of 
pedagogical and content knowledge oriented 
to teaching (Shulman, 1986) and meaning- 
making in the classrooms, for instance through 
explanations. 

Depending on the teacher-student inter- 
action, there are varying styles of explana- 
tions. First, the teacher can describe the learn- 
ers’ emergent ideas, connecting them with 
scientific models — this is known as the ‘think- 
ing together’ style. Second, the teacher can 
turn the explanation into a tale or narrative 
that blends the learners’ point of view with 
the concepts (Norris et al., 2005). Third, the 
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teacher can ask learners to communicate their 
ideas as the teacher would, which asks for re- 
description or re-interpretation of students’ 
ideas in other scientific terms, progressively 
using more precise language (Ogborn et al., 
1996). Thus, teacher explanation should not 
merely be an exposition by the teacher to an 
audience, but a dialogue that contrasts scien- 
tific ideas with student ideas. Indeed, learners 
can propose their ideas to the class in a form 
of an explanation (Dawes, 2004). From Feyn- 
man’s work (1994) it 1s clear that expert ex- 
plainers use their imaginary to make sense of 
non-observable, abstract or more difficult con- 
cepts. However, for novice learners, this task 
is not easy. 

Ogborn et al. (1996) indicated that ex- 
planation for teaching in the science class- 
room might include four tasks; marking the 
point between what the learners know and 
what they will know through the explanation, 
constructing the entities -1t means, the gestalt- 
of the explanation, transforming learners’ pri- 
or knowledge and illustrating the phenomena 
that can be explained. Nonetheless, there is a 
gap in assessing the elements that teachers use 
to make scientific concepts explicit to novice 
learners and then taking this knowledge into 
teacher education. 

Therefore, the question arises: what 
are the elements of pre-service teachers’ con- 
struction of explanations for the classroom’? 
From previous works in cognitive science and 
science education, it is plausible to interpret 
some criteria for the design of an assessment 
instrument with formative purposes. These 
follow in the next section. 


1.3. Teacher explanations elements 


The elements described below are in the 
rubric constructed in the present study. Our 
objective is to use the rubric to identify and 
assess the components for making explana- 
tory concepts explicit in science teacher ed- 
ucation. Each element is given a rationale for 
its inclusion. The first elements refer to the 
structure of the explanation, and the last are 
supports for representing the concepts or ideas 
and their connections 1n explanations. 


1.3.1. Structure of the explanation 
for teaching science 


Clarity of the elements of an explanation 
implies that the features, patterns and struc- 


ture of the content are illustrative and focused 
(Sevian and Gonsalves, 2008). If the ideas are 
difficult to understand, the explainer might 
slow the word flow (Mohan, 2013). This facili- 
tates using an understandable language for the 
learners, and concepts being presented in an 
appropriate vocabulary for the learners. Thus, 
when making a new concept explicit, it is use- 
ful first to describe the phenomenon, its char- 
acteristics and then explain the causes based 
on relevant scientific terminology (Wenham, 
2005). Additionally, avoiding tautology in the 
explanation favors its clarity (Geelan, 2012). 

Coherence and cohesion. Explanations 
do not only establish patterns or observable 
relationships. Explaining implies combining 
relationships which count as evidence for the 
causal reasons of a phenomenon (Windschitl, 
Thompson, Braaten and Stroupe, 2012). On 
one hand, coherence is about how the bits of 
the explanation are linked together to make 
sense (Mayer and Jackson, 2005). For 1in- 
stance, through cause and consequence one 
can make links between the parts of the expla- 
nation, exclusion or inclusion clauses, simular- 
ity, belonging, etc. On the other hand, cohesion 
implies connective links between the parts of 
the explanation that internally relates clauses 
and sentences (Rodrigues, 2010). Indeed, 
causal ties might define causality relationships 
between phenomena and the underlying prin- 
ciples (Sevian and Gonsalves, 2008). 

Sequence. The organization of the ele- 
ments of an explanation is crucial for effective 
science teaching (Mayer and Jackson, 2005). 
Explanations should have an organizer prin- 
ciple (Sevian and Gonsalves, 2008), which is 
usually called a sequence. Every part of the 
explanation should be deducible from the pre- 
cursor conditions (Wu and Shah, 2004). This 
sequence should reduce the cognitive load for 
the pupils (Cook, 2006). Avoiding unneeded 
or disconnected details is required because an 
excess of information can damage qualitative 
understanding in explanations (Mayer and 
Jackson, 2005). 

Accuracy. This refers to precision in the 
use of terms regarding current models of sci- 
entific concepts, theories or principles (Sevian 
and Gonsalves, 2008). Scientific accuracy 1s 
essential in making content explicit through 
explanations; however, simplifications are 
needed at times for building knowledge which 
is accessible to learners (Danielson, 2013). 

Completeness. Sufficiency or com- 
pleteness decides whether the globalization of 
the explanation contributes to understanding 
(Roth and Welzel, 2001). Are the components 
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of explanations sufficient or insufficient to un- 
derstand what the explainer wanted to explain? 
Explanations for the classroom have a teach- 
ing objective, thus, the explanation should 
cover thoroughly the concept(s) intended to 
be taught (Danielson, 2013). 

Connection with learners’ knowledge. 
This refers to building up the explanations 
upon students’ prior knowledge and concept- 
related experiences or ideas required to con- 
nect the explanation with the learners (Ogborn 
et al., 1996; Treagust and Harrison, 1999; 
Sevian and Gonsalves, 2008). Consequently, 
eliciting these before presenting new ideas 
is crucial (Marzano, Pickering and Pollock, 
2001). In cognitive terms, when new knowl- 
edge is intentionally connected with what 
learners already know, information retention 
increases (Cook, 2006). Thus, explanations 
should integrate or challenge students’ prior 
ideas about the phenomena (Smith, 2000). 


1.3.2. Explanation representational 
supports 


Analogies, metaphors, simulations and 
models. Analogies and metaphors help make 
meaning of abstract or complex content (Au- 
busson, Harrison and Ritchie, 2006; Daniels- 
son, Lofgren and Pettersson, 2018). Likewise, 
models and simulations stimulate inferences 
and conceptual insights because of the estab- 
lishment of relationships between variables. 
They also advance the conceptual understand- 
ing of scientific phenomena that are particu- 
larly abstract or complex (Podolefsky and 
Finkelstein, 2007). Simulations convert static 
concepts into dynamic visualizations (Bagla- 
ma et al., 2017), bringing concepts to “life” 
(Danielson, 2013). All of these elements facil- 
itate mental imagery of the concepts leading 
towards understanding the explanation (Gee- 
lan, 2013; Sevian and Gonsalves, 2008). 

Examples, experiments, graphs or imag- 
es. Relevant imagery helps students to clarify 
conceptual properties or characteristics which 
are usually difficult to imagine in phenomena 
or to recall from the learners’ daily life expe- 
rience (Buckley, 2000; Ogborn et al., 1996). 
Graphs are used to show variations in infor- 
mation (Kozma, 2003), as well as to represent 
dynamics and associations in processes (Cook, 
2006). These representations can help students 
develop insights into scientific understand- 
ing and detect gaps in their comprehension 
(Windschitl, Thompson, and Braaten, 2008). 
When explaining with images, it is relevant to 


point out the specific aspect of the concept be- 
ing illustrated (Sevian and Gonsalves, 2008). 
Likewise, in experiments it is valuable to 
call learners’ attention to the reasons the ex- 
periment processes worked or not in a defined 
way. Regarding knowledge structure, experts 
connect the explanations with the underlying 
principles to help learners to create mental 
models (Snyder, 2000). 

Gestures and voice inflections. Such 
cues serve as emphasis variation in explana- 
tions (Mohan, 2013). Body gestures help stu- 
dents’ comprehension processes when con- 
necting to the discourse of the explanation 
(Geelan, 2013). On the contrary, gestures 
might be useless or distractive if they are not 
representing an aspect of the concept (Sevian 
and Gonsalves, 2008). Hand and body ges- 
tures are part of non-verbal language useful 
to communicate conceptual properties (Roth 
and Welzel, 2001). Voice changes or speech 
pace variation might add relevance to certain 
parts of the explanation and help learners to 
discriminate between the relevant and the ir- 
relevant in an explanation (Sevian and Gon- 
salves, 2008). 

Promoting learning from misconcep- 
tions. Misconceptions are understood in this 
article as misunderstandings of specific infor- 
mation (Martin, Sexton and Gerlovich, 2009). 
Teachers need to prevent learners from con- 
structing common misconceptions, by inquir- 
ing, exploring and contrasting. Misconcep- 
tions are considered excellent tools to start 
making thinking processes visible for stu- 
dents; thus, misconceptions are approached as 
learning opportunities (Carrascosa, 2006). 


1.4. The current study 


This study explores and assesses the 
above elements in pre-service teachers’ ex- 
planations with a rubric constructed for for- 
mative assessment during teacher education. 
The rubric was developed as part of a broader 
research into how pre-service teachers might 
improve in their ability to make scientific con- 
cepts explicit for learners. The rubric embod- 
ies the assumption that there are elements of 
explanations, which are high-leverage; these 
are also more difficult to use and improve by 
pre-service teachers. 

This paper argues that the development 
of a rubric, which decomposes the practice of 
explaining concepts into several assessable 
elements, informed by cognitive science and 
science education, 1s a contribution for pre- 
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service teachers’ formative assessment, whilst 
also providing pre-classroom opportunities to 
rehearse and improve competencies for mak- 
ing concepts explicit for teaching science in 
classrooms. This should better prepare pre- 
service teachers to engage in high-leverage 
practices, which are known to promote learn- 
ers’ cognitive skills and engagement (Larkin, 
2017). 

The research questions were: 1. What 
are the elements of pre-service teachers’ ex- 
planations in a simulated context? 2. Can the 
elements be grouped in general constructs? 3. 
How can the elements be organized and im- 
proved? 


2. MATERIALS AND METHODS 


2.1. Research design 


The study was of a pre-post design based 
on quantitative measurements, but also ex- 
ploratory in the sense that qualitative analy- 
ses were undertaken. Thirty-eight pre-service 
teachers signed a consent to participate. The 
participants were undergraduate student sci- 
ence teachers in the last year of their program 
from three universities; they had small prior 
teaching experience of only a few weeks; the 
average age was 25 years and they belonged to 
low or lower-medium socio-economic status in 
the country, which is very similar to the back- 
ground origins of in-service teachers. Around 
40% identified themselves as male and 60% as 
female, which was also close to the distribu- 
tion of the in-service science teachers working 
force (38.6% and 61.4% respectively). They 
lived in an urban zone of the Chilean capital, 
Santiago. 

The sampling in this study was purpos- 
ive, looking for typical cases in which each 
university represented a unit of analysis. Ad- 
ditionally, the pre-service teachers invited to 
participate agreed to join the research project 
voluntarily. The process attempted to select 
information-rich data in accordance with Pat- 
ton (2001). 

The pre-service teachers joined a 
10-session peer assessment workshop, which 
occupied between one and two hours extra 
work per week. This workshop was undertak- 
en before they started their practicum. They 
were asked to explain a scientific concept to a 
simulated classroom composed of their class- 
mates in a microteaching episode. They then 
were set to discuss in groups of 4-5 partici- 


pants with formative peer assessment. At the 
end of the workshop, they performed a second 
microteaching episode. The micro-teaching 
episodes lasted from 7 to 20 minutes and were 
recorded for further analysis. Only 20 partici- 
pants completed both episodes and at least 6 
of the 10 sessions, and these constituted the 
final sample. 


2.2. Development and application of 
the assessment instrument 


Nineteen initial aspects of explanations 
were proposed, sourced from the literature in 
science education and cognitive science. There 
were specific elements for science education, 
but some of the others could also be applied to 
other subjects. Elements which were too wide 
were discarded to maintain the focus on expla- 
nations. Then the 17 aspects remaining were 
decomposed into three levels of completion. 
Each level contained observable features that 
could be addressed during teaching based on 
explanations. These were adjusted by science 
teacher experts’ judgment, grouping some ele- 
ments because of the role played in an expla- 
nation. For instance, the examples, graphs, 1m- 
ages and experiments were organized together 
as constituents which illustrated or clarified 
aspects/properties of the concept being ex- 
plained. Table | details the process. 


Table 1. Criteria from literature review 
and process 


Criterion Process 
(1) Explanation aims Deleted 
(2) Explanation context Deleted 
(3) Clarity Maintained 
(4) Coherence and cohesion Maintained 
(5) Sequence Maintained 
(6) Accuracy Maintained 
(7) Links with learners’ prior ideas 
0 eee a ee et Grouped 
(8) Links with learners’ life 
(9) Using examples 
(10) Using experiment and demonstra- 
; Grouped 
tion 
(11) Using graph and imagery 
(12) Using metaphor and analogy 
<=. 6. abide SCO 
(13) Using simulation and model 
(14) Using body gestures 
7 —— - Grouped 
(15) Inflections in voice 
16) Approaching misconceptions as 
a ie ‘ : : Maintained 
learning opportunities 
(17) Summary of the explanation Deleted 
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The same process worked with criteria 
7 and 8, 12 and 13, 14 and 15. The criteria 
1, 2, and 17 were removed because it would 
not be possible to observe them in a teach- 
ing episode. The experts suggested including 
the criteria of completeness and sufficiency, 
which implied that the components of the ex- 
planation should be enough to understand the 
targeted concept. Thus, a ten-criterion version 
rubric was obtained, and we called it REC 
(Rubric for formative assessment of Explana- 
tions of scientific Concepts). 

REC was tested in a pilot study with 
17 science lessons videotaped in different 
real teaching contexts by beginning teach- 
ers. This led to 60 explanations in total as a 
lesson contained more than one explanation. 
The coding system was double-blinded, inter- 
rater reliability was calculated and Pearson’s 
correlations were used for analysis. The inter- 
nal consistency (reliability) of the rubric was 
a = 0.60 (n=10), to which every element had 
contributed. In line with the literature review, 
reorganization of the elements based on their 
correlations was done instead of deletion. Af- 
ter this pilot test, REC was further validated 
by expert panel revision. Instrument develop- 
ers at The National Teacher Assessment Sys- 
tem for public education in Chile collaborated. 
They suggested some language modification 
and re-ordering of some performance levels. 
This last version (see Appendix) was applied 
to forty of the pre-service teachers’ microte- 
aching episodes recorded. 

In order to assure reliability, 100 % of 
the videos were blind double-coded. Inter-rater 
agreement was 80.35 %. The rubric was found 
to be reliable for this group (a = .77, n=10) 
and all the elements contributed to its inter- 
nal consistency. No element, if deleted, would 
have substantially increased the reliability. 
Around half of the correlations between the 
elements (E) were statistically significant (p<. 
05), and all elements were statistically signifi- 
cantly correlated with the total (T) score (Ta- 
ble 2, presented in the next page). Each level 
of assessment was used at least once, which 
supports their applicability and pertinence to 
assess pre-service teacher explanations. 


Table 2. Correlation matrix of the final 
rubric 


El FE? §F3 E4 ES E56 EY §E8&8 


E9 
a4 





CI] Correlation 1s sigmficant at the 0.01 level (2-tailed) 
_] Correlation 1s significant at the 0.05 level (2-tailed) 


3. RESULTS 


The participants’ initial microteaching 
episodes showed a varied outline, featuring 
high and low scores in the criteria. There were 
a few participants with obtained high scores, 
however, the general pattern observed was 
based on medium levels of performance when 
marked against the rubric. Most of the ele- 
ments that pre-service teachers showed - at the 
moment of making concepts explicit through 
explanations - were half achieved. 

The minimum score obtained in a mi- 
croteaching explanation episode was 5 out of 
20, the maximum 17, and the standard devi- 
ation was 3.38. 

The rubric elements that were the most 
developed in this group were the sequence of 
the explanation (SQ3) and using an example, 
graph or image in the explanation (SQ8). On 
the contrary, difficulties were found in us- 
ing analogies, metaphors or models, and ap- 
proaching misconceptions as learning op- 
portunities for making concepts explicit to the 
learners. The other criteria were considered to 
be at a medium level. 

After the workshop, the participants’ 
final microteaching episodes presented a wider 
spectrum in the elements for making concepts 
explicit through explanations. The minimum 
score in the whole group was 6 out of 20, the 
maximum was 19, with a standard deviation 
of 3.38. 

The whole groups’ pre and post scores 
are shown in Figure 1. There were score cri- 
teria (SQ) with a marked improvement after 
the workshop in some (1.e. SQ1, SQ6), al- 
most no advance in others (i.e. SQ3, SQ5) or 
a decrease in a criterion (SQ8). 

If we compare the means of the pre and 
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post scores, the pre-service teachers’ expla- 
nations were rated higher after the workshop 
than at the beginning (mean pre-test=10.1, SD 
=3.38; mean post-test=14.65; SD =3.38). The 
difference was 4.55 points. The effect size was 
high (d=1.34) (Cohen’s delta). 


| 
$sql $Q2 $Q: 


3 s$a4 $as $O6 $Q7 sas sags $Qi10 





i 





oS 


MAverage score pre M®Average score post 


Figure 1. Comparison of scores pre and 
post work-shop using the rubric REC 


One-way ANOVA identified significant 
differences between the scores obtained at the 
pre and post measurements (F=16.54, df=39, 
p<.001), as shown in Table 3. Thus, there 
were changes in participant teachers’ ways of 
explaining after peer assessment based on the 
rubric, which suggest an advance in this cru- 
cial teaching practice. 


Table 3. ANOVA one-way pre and post 














workshop 

Sum of Mean 

Sig. 

Squares Square : 
Between 

189.225 1 189.225 16.540 .000 
Groups 
Within 

434.750 38 11.441 
Groups 
Total 623.975 39 





Looking at case-to-case instances, only 
two pre-service teachers had difficulties with 
improving their initial score. Otherwise, the 
participants with low initial scores showed 
the greatest improvements at the end of the 
workshop. This suggests that formative peer 
assessment based on the rubric was especially 
appropriate for participants with greater difh- 
culties in making scientific concepts explicit 
through explanations. 

Regarding the general pattern, the ma- 
jority of elements had a better score after the 
peer assessment workshop. Nonetheless, the 
weakest criteria at the beginning (SQ7, SQ10) 


were also the lowest criteria once the work- 
shop ended. This suggests those elements need 
more support to be performed in a high level 
by pre-service teachers. Perhaps explanation 
based on metaphors, analogies or models re- 
quire more refined content knowledge, which 
was not the focus of this workshop. They 
might also require extra time and dedicated 
interventions based on the intersection of ped- 
agogical and content knowledge to reach the 
level expected by the rubric. 


4. DISCUSSION 


The rubric presented in this paper was 
useful in identifying strengths and areas for 
further development in pre-service teachers 
explanations. Making scientific concepts ex- 
plicit through metaphors, analogies or mod- 
els is relevant for teaching from a cognitive 
perspective, because they require higher-order 
thinking skills and flexibility of thinking (Og- 
born et al., 1996). Moreover, they enhance 
students’ representation and mental model 
construction (Aubusson, Harrison and Ritchie, 
2006; Danielsson, Lofgren and Pettersson, 
2018). However, they need a focused strategy 
to be improved in teacher education. Teachers’ 
content knowledge has a role in their instruc- 
tional representations (Danielsson, Lofgren 
and Pettersson, 2018). Perhaps a well-inte- 
grated, precise and intellectually challenging 
understanding of science would favor cogni- 
tively oriented teaching practice through ex- 
planations. Pedagogical experience 1s relevant 
for designing student-centered teaching prac- 
tices (Koteva-Mojsovska and Nikodinovska, 
2015), including simulated teaching practices 
as in our study. 

In this paper, the easiest elements of the 
pattern in which pre-service teachers made 
scientific concepts explicit through explana- 
tions were clarity (SQ1) and connection with 
students’ prior knowledge and experience 
(SQ6). After the workshop the rubric detected 
clearer explanations, which were connected 
with students’ prior understandings and con- 
structed from a synergy of teachers’ and stu- 
dents’ ideas - which is a prominent principle 
in a constructivist approach for science educa- 
tion (Geelan, 2012). 

Otherwise, the rubric detected one ele- 
ment of explanation without improvement af- 
ter peer assessment; using examples, graphic 
representations and images. These were the 
strongest elements at the beginning of the 
workshop. However, the participants reported 
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that after peer discussion about the character- 
istics of cognitively challenging examples, a 
few of them were more confident to use other 
resources such as analogies in the final mi- 
croteaching episode, which might explain the 
decrease. 

In summary, the development and ap- 
plication of the rubric allowed the diagnosis 
and improvement of participants’ explanations 
in terms of explanatory clarity, coherence and 
cohesion of parts, sequence and sufficiency re- 
garding the pedagogical aim, connection with 
students’ prior ideas or experiences, and use 
of non-verbal language for representation and 
emphases. 

Regarding the limitations of this re- 
search, as the participant selection was not 
randomized but voluntary based on a work- 
shop invitation, statistical analysis such as fac- 
tor analysis of the rubric were not used. Addi- 
tionally, a comparison group was not available 
and the participants could abandon the work- 
shop at anytime for ethical reasons. Thus, only 
data from participants with a minimum of 6 
out to 10 sessions attended was considered for 
the results, so the initial sample size was re- 
duced. For further research, better incentives 
for participants to remain during the work- 
shops will be crucial. 

The numerical comparison obtained 
through the rubric was based solely on an ele- 
ment’s absence, presence and a quality aspect 
when performed. Hence, each element could 
have a score of 0, 1 or 2. Thus, only for com- 
parative purposes can we establish a general 
pattern designed to give feedback to pre-ser- 
vice teachers to enable improving the weak el- 
ements. This 1s a limitation of other potential 
uses of the rubric such as promotion of teach- 
ers or other high-stake consequences. 

Otherwise, considering explaining as 
a central competence for science teaching 
(Geelan, 2012), the present study contributes 
evidence for developing high-leverage prac- 
tice before science teachers face the multiple 
challenges of real school settings. The study 
presented here highlights the relevance of pre- 
paring new teachers with varied strategies for 
making concepts explicit in the classroom. 
The rubric constructed for formative assess- 
ment is a tool for teacher education. 

Moreover, the present study opens a 
discussion surrounding Pedagogical Content 
Knowledge (PCK) development in pre-service 
teachers. Making scientific concepts explicit 
through teaching requires PCK and practical 
experience. Shulman’s postulates (1986) have 
remarked that PCK, as the amalgam between 


content, pedagogical and context knowledge, 
needs teaching practice and synergy to be 
crafted. The present research resonates with 
this, but expands the argument. Pedagogical 
Content Knowledge for making scientific con- 
cepts explicit for teaching can be developed 
during initial teacher education, if targeted 
practices are decomposed and rehearsed in 
protected formative context. Teaching practice 
in simulated settings might be introduced as a 
resource in the early stages of teacher educa- 
tion, which opens new research questions. 

The present research also contributes to 
help fill the gap in the literature concerning 
the construction of explanations by science 
pre-service teachers - particularly regarding 
the elements for making scientific concepts 
explicit. Although the literature review sug- 
gested some features of effective explana- 
tions, such as adequacy to the audience (Nor- 
ris et al., 2005; Sevian and Gonsalves, 2008) 
and the giving of examples (Buckley, 2000; 
Ogborn et al., 1996), no prior reference was 
found on how to transform those elements into 
assessment criteria for formative purposes in 
teacher education. 

This paper also provides an organized 
and conceptually valid rubric to formatively 
assess pre-service science teacher explana- 
tions. The rubric was designed for diagnosing 
and intervening in teacher education, but also 
as a progress monitoring instrument, which is 
a novel contribution to the field of research in 
education and the practice of teaching. 


5. CONCLUSIONS 


Regarding the research question about 
the elements of pre-service teachers’ expla- 
nations in a simulated context, this study has 
documented some diverse criteria of science 
teachers’ explanations present in the cogni- 
tive science literature and described their 
assessment within the frame of the develop- 
ment of a rubric for teacher education. The 
findings showed the explanation strengths of 
pre-service teachers in explaining based on 
examples, graphs and images. However, dif- 
ficulties were found in using and improving 
analogies, metaphors, and models, and ap- 
proaching misconceptions as learning oppor- 
tunities, which have to be addressed. 

The rubric REC grouped structural and 
supportive elements in three levels of perfor- 
mance, based on conceptual features and the 
function they have on sharing and construct- 
ing meaning in the explanation. This organi- 
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zation answers the second research question; 
Can the elements be grouped in general con- 
structs? (see REC in Appendix). 

The third question of this study referred 
to the extent to which the elements of explana- 
tions can be organized and improved. The in- 
strument has detected patterns and changes in 
simulating a high-leverage teaching practice; 
making scientific concepts explicit through 
explanations. This sensitive detection allows 
monitoring of constraints and advances during 
teacher education. There were statistically sig- 
nificant changes in participant teachers’ ways 
of explaining after peer assessment, which 
suggest an advance in this crucial teaching 
practice. A large effect size was found (not- 
withstanding the small sample). 

Thus, from this work, we recommend 
that teacher educators give opportunities to 
simulate, rehearse and assess teaching prac- 
tices conducive to learning with a formative 
purpose, such as explaining for the classroom. 

It 1s important to highlight that explana- 
tions for the classroom are different from sci- 
entific explanations. It is not enough to know 
explanations from science to explain suc- 
cessfully in the classroom. One of the criti- 
cal aspects of teacher education is helping 
pre-service teachers to develop knowledge 
integrated with skills for teaching. Simulating 
explanations for the science classroom syn- 
ergizes content knowledge and pedagogical 
content knowledge in one practice that has a 
strong influence on learning. Therefore, it is 
necessary that teacher education provides the 
learning scenarios for this to happen. We have 
described in this work the decomposition of 
practice for helping pre-service teachers to 
build skills and confidence, through formative 
peer assessment facilitated by the rubric REC, 
which we suggest especially for their weak- 
nesses. 

We know that school contexts present 
several challenges - many times the complex 
and simultaneous demands of real classrooms 
are shocking for new teachers. Hence, we rec- 
ommend gradually introducing pre-service 
teachers to real settings of practice to allow 
them to orchestrate the bits and pieces needed 
for teaching diverse groups of students with 
different conditions and needs. 

Simulation of relevant teaching practic- 
es, as in our study with explanations, together 
with a climate of constructive assessment and 
a detailed analysis of teaching practices can 
not only improve the preparedness to teach, 
but also help to build a culture of formative 
peer assessment with instruments such as 


REC that diagnoses, facilitates and monitors 
changes in high-leverage teaching practices. 

Besides, this study echoes with the in- 
creased relevance of student-centered teach- 
ing approaches, not only in schools but also in 
teacher preparation programs. 
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APPENDIX 


Rubric for formative assessment of Explanations of scientific Concepts (REC). Adapted 
from Cabello, (2013) 


Criteria Level 0 Level 1 Level 2 
SQ1 Clarity The explanation doesnot Firsttheexplanationdescribes First the explanation describes 
complete the levels lor?, theconcept,thenthenameor the concept, then the name or 
or the explanation is con- definition comes, definition comes, 
fusing, vague or tautologi- or and 
cal The explanation language is The explanation language is 
understandable forthe learners understandable for the learners 
SQ2 Coher- Theexplanationdoesnot Every partofthe explanation Every part of the explanation 
ence and co- complete the levels 1 or? has a relation (i.e. has a relation (1.e. 
hesion cause/consequence, inclu- cause/consequence, inclu- 
sion/exclusion, differentiation’ sion/exclusion, differentiation’ 
similarity) with the next part, similarity) with the next part, 
or and 
The explanation has strong The explanation has strong 
unifying ties unifying ties 
5Q3 Se- The explanation does not The explanation has a pro- The explanation has a pro- 
quence complete the levels lor? gressive (logical) sequence, gressive (logical) sequence, 
or and 
The ideas inthe explanation The ideas in the explanation 
scaffold the construction of scaffold the construction of 
the concept the concept 
504 Cor- Theexplanationcontains Theexplanationcontainsin- The explanation does not con- 
rectness inaccuracies that drive accuracies which do not drive tain inaccuracies 
learners to mistakes learners to mistakes, however, or 
or the concept remains vague There are some generalisa- 
The explanation contains a tions which are essential for 
conceptual error the learning process 
$Q5 cCom-- The explanation shows The explanation shows some The explanation shows the 
pleteness mainly elements notcon- elements contributingtothe main elements contributing to 
tributing to the construc- construction of the concept —_‘ the construction of the concept 
tion of the concept 
$Q6 Connec- The explanation does not The teacher identifies stu- The teacher identifies stu- 
tion with complete the levels 1 or2 dents’ own ideas or remarks dents’ own ideas or remarks 
learners’ learners’ everyday life facets learners’ everyday life facets 
knowledge related to the concept without related to the concept. 
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Achieved (2) 


The explanation contaims a correct 
analogy, metaphor, smmulation or 
model, 
and 
The concept features related to the 
analogy, metaphor, sumulation or 
model are clear and evident 
The explanation mcludes an ex- 
ample, sraph or mage to support 

the explana 
and 
The concept features relatedto the 





ton, 


example, graph or mage are illus- 
trated 


The teacher uses gestures to sup- 
port the explanation, 
and 
The teacher uses the voice or 
speech pace to highhght some 
elements of the explanation 


The teacher shows a misconcep- 
lon or common mistake, 
and 
addresses how students can leam 
from this 


Criteria/level Not achieved (0) Half achieved (1) 
=O? Meta- The explanation does The explanation contains a 
phor, analo- not contain a correct correct analogy, metaphor, 
fy, simula- analogy, metaphor, sim- snmulation or model, but 
tion or model ulation or model, the concept features relat- 
mage ed to the analogy, meta- 
phor, sunulation or model 
are not evident 
S08 Exam- The explanation does The explanation mecludes 
ple, experi- not complete the levels an example, graph or mm- 
ment, graph lor? age to support the expla- 
or Image us- nation, 
age but 
The concept features re- 
latedto the example, graph 
Or image are not Ulustrated 
O° Ges- The explanation does The teacher uses gestures 
tures and not complete the levels to supportthe explanation, 
speech usage lor2 or 
The teacher uses the voice 
or speech pace to hnghhght 
some elements of the ex- 
planation 
3010 Mis- The explanation does The teacher shows a mus- 
conception as not complete the levels conception or common 
a learning lor? mistake without 
opportunity encouraging students to 
leam from this 
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